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ABSTRACT ' • , 

Possible bias in selection procedures used for . 
employment and college admissions is of great social and educational 
importance. However, there are many different definitions of what 
constitutes bias, with each definition based on different values and 
with different implications for how selection ■should be. accomplished. 
A number of these definitions of bias and their implications are 
examined in his document, and a new model of fairness based oh equal 
opportunity for potentially successful applicants is presented. The 
equal opportunity model is suggested as an 'intuitively appealing and 
socially desirable model for use in many selection .situations . 
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Nancy'S. Cdle 1 *» 



.. The issue of bia&in the use of tests .for the 
selection of minority group members fo'r employ- 
ment and for admission to college has recfeived 
much attention in recent years. However, in spite 
.of wide concern with the issue and its btoad 
implications for our society, there has been little 
agreement about what constitutes bias or what 
procedures should be followed to alleviate it. - 
i It *b the purpose of this paper to identify the 
values and beliefs "jjbout fairness .which are the 
Jaases-for several. definitions of bias^and to prpyide 
aptual procedures for the practitioner to. follow to 
alleviate bias according to the definition he' 

tv . » 

•^chooses. In addition, a new definition ofbias based 
‘‘on the concept of equal opportunity f< V /the 
potentially, successful applicant regardless of group 
membership is presented and suggested as an 
intuitively appealing and society desirable idea of 
fairness for many, selectipn situations in employ- 
. ment and college admissions. 



The Quota Mode I 



- , The quota model of bias' involves th'e idea that 
fairness lies In some specified proportional repre- 
sentc/tiom For example, a procedure which requires 
a priori that half of those selected must be 1 men 
^pnd half women is. based on a quota model. 
Similarly, another- quota model might requite that 
the proportion of minority; members employed by . 
a firm, match the proportion of minority members , 
in the population'. In both cases, the proportiopal 
representation of particular groups is specified 
a priori on the basis of value judgments about 
fairness, and any procedure which fails to yield the\ 
“specified proportions is considered biased. ' 



The Regression Model *' 

X. 
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* Definitions of Selection ^ias 



\ 



The regression model of test bias follows from 
definitions* of bias which deal with consistent 
errors of prediction. For example, Cleary* (1968) 
^defined .bias in the following way: 



Six models of selection bias, or its converse 
selection fairness, will be considered. They will be 
referred to here as the quota model, the regression' 
model, the Darlington model, the employer's 



- / 



A test is biased for members of a subgroup of the 
population if, in the prediction of a criterion for which the 
test is designed, consistent nonzero errors of prediction are 
made for members of the subgroup (p. 115 ]. 



model, the Vmjrndike 
ppportunity modtl. 



model,, and the equal. 



Jhe author acknowledges the rr^ny helpful suggestions of James 
W. L. Cole,. Gary R. Hanson, Leo A. Munday, and Melvin R. Novick 
in the preparation of this paper. 
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Ariastasi (1,968) gave a' similar definition: "Test 
bias refers to overprediction or underprediction of 

I 

criterion measures [p. 559]." These definitions 
assume that fairness is achieved by 'selecting on the 
basis of predictions of a criterion score and lead to 
the examination of regression equations in the 
separate groups *for consistent errors of prediction. 

The regression model of>bias has been followed 
in a number of empirical studies of bias in the use 
of tests in cortege admissions (e.g;. Bowers, 1970; 
Cleary, 1^68; Temp,? T971). These studies have 
been ‘concerned With possible bias in the qse with 
minority group members of regression .equations' 
based on a majority group. If the regression lines 
are identical in the groups, then the use of a single 
prediction equation is considered fair. However, if 
ttfb equations are no*t identical, then separate 
regression equations must be used according to this 

definition of fairness. 

\ • • 

Under a "fair" regression procedjire-iri which 
separate <within-group regressio n ^eq uations are 
used, the selecting institution is assured of the. 
selection of those applicants with the highest 
predicted criterion scores on the basis of the 
available predictor variables. However, if the pre- 
diction is poorer in one group than in another, 
then the selection cutoff point will be relatively 
high#: in the group with the poorer prediction. 
Intuitively, when, prediction is poor, , one might 
vyish the cutoff points to.be .lowered to reflect the 
increased uncertainty. Under the regression model 
the opposite occurs, and members of groups for 
which prediction is poor are penalized in :the 
selection process. 



The Darlington Model . 



Darlington (1971) argued that fairness can be 
achieved only by a kind of combination of the 
regression model and the type of value judgments 
made in the quota model. According to this model, 
one must. first decide if there isjspecjal value in the 
selection of members of some cultural group. If so, 
then one accepts some difference between criterion 
scores.which will yield equally^ desirable candidates 
frOm different groups. * 



For example, if it is valuable to obtain minority 
group members, .dne might decide that a minority 
member's score of Y op a criterion is as desirable as 
a score of ,Y •+ k on the criterion for majority 
members. Using a variable C vyhich has value zero 
for minority group members and one, for majority 
’ group members, a difference of k on Y is equiva- 
lent to a difference of one on C. Thus, by selecting ^ 
on the basi$of the variable Y — kC, the subjective 
judgment about the importencfe of select in g-minor- 
■ ity group members can "be implemented; and in, 
Darlington's terms a culturally optimum procedure 

i ^ 

is achieved. When k is set fequal to zero (when there 
is no reason to ‘ favor one cultural qroup), this 

model reduces to the regression mode 1 . 
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The Employer Model 
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\ .Another-definition of bias has led to a different 
selection model. Guidn.(1966) stated that 



unfair discrimination . cx-.'.ts ' when persons with equal 
probabilities of success on the job haVe unequal probabili- 
ties of being hired for the job (p, 26 ] . 



This definition was implemented in a model 
proposed by Einhorn and Bass (1971). 

Einhorn and Bass, by considering the d istribu- 
- tion of criterion scores about the regression line, 
prescribed predictqr cutoff points for each sub- 
g 'up above which applicants have a specific 
minimal chance of being successful (or scoring 
abbve some specified criterfon). For example, 
suppose an employer (or- selector) is willing to hire 
all applicants with at least a 70% chance of success 
-(or a 30% risk) as gauged by the predictor variables 
. used. Then, the predictor cutoff is chosen at the 
point , at which the criterion pass point (Y p ) is 
approximately one-half standard error of estimate 
below -the predicted criterion (Y)' since 

* y ^ ’ ’ f> . s * 

about 70% of the cases fall above minus one-half 
standard deviation* n a normal distribution. In 
. terms of a unit normal deviate Z p , where Z D = 
. ' (Y p - Y)/cfy x , Pr {Z > Z-> - .70. 



Because the employer (or selector) can set the 
level of risk he is willing to assume, this model is 
especially advantageous to the employer— hence, 
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the reference to Jt !fs the employer's model. 
However, as with the regression' model, poor • 
prediction intone group decreases the chances of 
selection of members of that group. When the 
prediction is poor, the standard errcyof estimate is 
large; consequently, a higher predicted score (and 
predictor cutoff) is required to maintain the same.* 
one-half standard error of estimate difference 
betvyeen predicted criterion and the criterion pass ' 
point in the example. Thus, po<|r prediction lowers 
the chances, of success of a person with a high 
predictor score and consequently decreases his 
chance of selection. 



The Thorndike Model 



Thorndike (197 1^ proposed yet a fifth defini; 
tion^of bias or its complement, fairness. In a fair 
selection procedure-, 



the qualifying scores on a test should be set at levels that 



will qualify applicants in the two groups in proportion' to 



/ 



the fraction of the iwo groups reaching a specified levejof 






criterion performance [p. 631. 



/ 



Although more complicated sounding /at -first 
glance, Thorndike's is* actually a very simple 
notion. If, in Group A, 50% of the members are 
successful and, in Group B, 80% of the members 
are successful, then .the proportion of Gfoup A 
members selected t a those selected from Group B 
should match the' 50:80 success ratio. Thus, 
Thorndike's model requires that the success ratio 
equal the selection ratio, or in terms of probability 
statements, \ 



V. 



I / ; • ^ 

the selection cutoff points .in the two groups on 

/ 

the predictor variable. 

Thorndike's idea of^airness as. a match of 
selection rate to'success rate has intuitive appeal in 
that it elimirwtes thfe inequity of over-selecting in a 
group in which prediction is better even when a 
substantial proportion of the. group with poorer 
prediction could succeed if selected. Thus, whereas 
the regression and employer's models are advan- 
tageous primarily ' from the selecting institution's 
point of view, Thorndike's model proposes a kind 
t>f fairness more nearly appropriate from the 
applicant's viewpoint. The model of bias proposed 
next, can be seen as a logical extension and 



refinement of the Thorndike model to an even 

i • 

more intuitively appealing idea, of fairness to the 



applicant in a selection proce'ss 



I 



The Equal Opportunity Model J 



‘ In many selection situatio ns, the applicant who, 
if selected, would be able to succeed, deserves a 
guarantee of fairness in selectioq. Usually, not all 
potentially successful ap,plicants*\oan be selected 
both because too few positions a fe available and 
because one k unable to identify in advance with 
surety who will and who will not Succeed, how- 
ever, when the distribution of a predictor and a 
criterion cf success are known by pa^t experience, 
one can compute v the probability that a potentially 
successful applicant has of being selectecT' given a 
fixed selection procedure. .. \ * 

Under each of the previous rn6dels discussed, it 



may happen that the chance'^of selection of a 



Pr, { Y> Y n } 



Pr, {X> X,} 



( 1 ) 



Pr 2 fY>Y p } • • Pr 2 {*>X 2 } 



where X is the predictor variable in the two groups, 
Y the criterion, Yp the criterion "pass point" or 
the predetermined criterion level of success, and X 



potentially successful applicant in Gr*pup A is 
, different from the chance of selection of such ah 
applicant, in Group °B. Thus, two applicants, bofh 
i-of-whom-couldjjucceed (achieve a criterion' score 
above a criterion p^ point) if selected, may have 
different ocha.nces of sdTection because ]oT tfieir 
group membership. Under the equal opportunity 
model this type of unfairness is eliminated. * 

The principle of the equal opportunity model is 
that, as a group, people who can achieve a 



c 



satisfactory criterion score (Y > Y p ) should have 



the same probability of being selected whether 
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